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Future missions of gravitational-wave astronomy will be operated by space-based interferometers, 
covering very wide range of frequency. Search for stochastic gravitational- wave backgrounds (GWBs) 
is one of the main targets for such missions, and we here discuss the prospects for direct measurement 
of isotropic and anisotropic components of (primordial) GWBs around the frequency 0.1 — 10 Hz. 
After extending the theoretical basis for correlation analysis, we evaluate the sensitivity and the 
signal-to-noise ratio for the proposed future space interferometer missions, like Big-Bang Observer 
(BBO), Deci-Hertz Interferometer Gravitational- wave Observer (DECIGO) and recently proposed 
■ Fabry-Perot type DECIGO. The astrophysical foregrounds which are expected at low frequency may 

' be a big obstacle and significantly reduce the signal-to-noise ratio of GWBs. As a result, minimum 

detectable amplitude may reach /i 2 f2 gw = 10 -15 ~ 10~ 16 , as long as foreground point sources are 
properly subtracted. Based on correlation analysis, we also discuss measurement of anisotropies 
' of GWBs. As an example, the sensitivity level required for detecting the dipole moment of GWB 

D , induced by the proper motion of our local system is closely examined. 
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I. INTRODUCTION 



The operation, construction and new projects of a number of new and next-generation gravitational-wave detectors 
are currently underway, and they will constitute a global network of detectors in a near future. Furthermore, future 
\ missions of gravitational-wave astronomy will be operated by space-based interferometers. As a result, gravitational- 
*n ■ wave searches will be performed in a very wide range of frequency band. The current searches of gravitational waves 
(GWs) are mainly classified into four types; coalescing binary systems (e.g., [II ) continuous waves with very 
slow evolution £| , (stochastic) gravitational- wave backgrounds (GWBs) and gravitational- wave bursts HI. The 
^ ' subject of this paper is a stochastic background probed by future missions of space-based interferometers. 
Ch . A stochastic background of gravitational waves could result from random superposition of an extremely large 
number of weak, independent and unresolved gravitational waves (sources) . This type of GWB is produced in many 
processes during cosmological and astrophysical evolutions, so that the spectrum is characterized by the generation 
mechanism. For example, a standard inflation model predicts a nearly scale-invariant spectrum of f2 gw (/), where 
figw(/) denotes the gravitational-wave energy density divided by the critical energy density to close the universe, 
whereas the large population of Galactic and extra Galactic binary systems makes up stochastic backgrounds known 
as a confusion noise, which sometimes dominates instrumental noises of a detector. Therefore, exploring GWBs 
brings us a new and interesting window to probe the early universe, as well as the astrophysical objects (see, e.g., 
Refs. SiMIIllllIll). 

Currently, several future missions of space-based interferometers have been proposed as follow-on missions of Laser 
Interferometer Space Antenna (LISA)[1J|. A main target of these missions is the primordial GWB produced during 
the inflationary epoch. While the conceptual designs of these projects differ from each other, it is commonly believed 
that the frequencies around 0.1 < / < 10 Hz may be one of the best observational window filling the gap between 
the frequency covered by LISA and the ground-based detectors. We then wish to know the sensitivity of the next- 
generation space interferometers to the stochastic GWBs and to study the basic aspects of the signal processing 
strategy as well as the characteristics of each detector. To address these issues, the correlation analysis plays a key 
role since it is necessary to detect the stochastic signals in the presence of random noises. As we have mentioned, 
not only the instrumental noises but also the stochastic signals themselves become a disturbance and prevent us 
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from the detection of primordial GWBs. In this respect, the optimally filtered signal-processing is suitable for the 
correlation analysis. In this paper, together with some extensions of the theoretical basis for the optimal-filtered signal 
processing, we discuss the sensitivity of the next-generation space interferometers and study the prospects for direct 
measurement of primordial GWBs. In addition, we also address the feasibility of direct measurement for anisotropic 
component of GWB. As for future space interferometers, we will consider DECIGO/BBO d, EE E3 

and recently 

proposed Fabry-Perot type space interferometer (FP-DECIGO) (see for its pre-conceptual design). 

The paper is organized as follows. In Sec. [HI we begin by describing the properties of a stochastic background and 
statistical assumptions. In Sec. IIIII we analyze the signal processing required for the optimal detection of GWBs by 
space-interferometers, in both the isotropic and the anisotropic GWB cases. Based on this, in Sec. IIVI we study the 
sensitivity of next-generation space interferometers to the stochastic GWBs. We will quantify the minimum detectable 
amplitude of f2 gw , taking account of the astrophysical foregrounds in the low frequency band. As an application of 
our formulation, we also discuss the detectability of dipole moment induced by the proper motion of our local system. 
Finally, Sec. is devoted to a summary and discussion. Throughout the paper, we adopt the unit c = 1. 



II. PRELIMINARIES 



Let us start by briefly reviewing basic concepts of data analysis for detecting stochastic GWBs. For readers familiar 
with these subjects, one may skip this section and move to Sec. IIIII 

The gravitational-wave detectors measure the time variation of spacetime metric as one-dimensional time-series 
data. Denoting the signal strain measured by the interferometer I (whose position is located at x,) by hj(t), it is 
expressed in terms of the superposition of the plane- waves by 

M*) = E f°° df i dn D^(o,/;t)4(o)fe A (/,n)e 2 "^-^), (1) 

A=+.x J ~°° Js2 

where e^(fi) is the spin-2 polarization tensors and hA(f,^l) is amplitude of gravitational wave. The quantity 
denotes detector tensor, which manifestly depends on an observed frequency / and an arrival direction of gravitational 
waves. Further, it may also vary in time due to non-stationarity of detector's (orbital) motion. A functional form of 
the detector tensor generally depends on design of interferometer as well as a signal processing method and it plays 
a crucial role when discussing detectability of gravitational waves fSec. IIVI) . 

By definition, the amplitude and polarization of GWB are statistically random, and the signal is usually assumed 
to be Gaussian with zero-mean. In this case, the statistical properties are completely characterized by the power 
spectral density Sh- 

(/&(/, n)M/',n')) = \s{f-f) <52( ";" s AA , Sh(\f\, n), (2) 

where ( ) stands for an ensemble average. We do not assume isotropy of GWBs and hence the spectral density Sh 
becomes the function of two-sphere f2 in addition to / [lH l20l| . The power spectrum density Sh is related to the 
dimensionless quantity fl gw commonly used in the literature, which is the ratio of GW energy density dp gw contained 
in the frequency range f to f + df to the critical energy density, p CYlt = 3Hq/8itG. Using Eq. @ and the plane wave 
expansion of the gravitational waves, one gets for / > 



"gwUJ-„ J,„ t - O Tj2 I A- 1 ) W 



i dp su , = 8^ f_ rdns h (f,n) 

Pcrit dlnf 3 Hi J 4?r 

where the factor ^ comes from our one-sided normalization in Eq. J5J). 

An output Sj(t) of detector is given by a superposition of gravitational- wave signal h(t) and instrumental noise 
nj(t), i.e., Sj(t) = hj(t) + nj{t). Here, we assume that the noise obeys stationary Gaussian process. The power 
spectral density of noise is given by in Fourier space 

(n*Af)n,(f)) = ls iJ 5(f-f')N I (f), (4) 

In the presence of additive noises, a single-detector measurement cannot separate the signal h{t) from the instrumental 
noise and a reliable detection of the GWBs is impossible unless the amplitude of signal is large compared to the noises. 
Thus, one needs the other outputs and performs a correlation analysis. Provided several independent output data, 
the correlation analysis is examined by forming a product by multiplying data sets together and integrating over time: 

ft+r/2 rt+r/2 

SrAt) = / df dt" Sl (t')sj(t")Q(t' -t"), (5) 

Jt-r/2 Jt-r/2 
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where Q(t) is an optimal filter function, which we will discuss in detail, r is the local observation time corresponding 
to the time interval of chunk data. We assume that r is smaller than the total observation time T a ^ s , which is 
comparable to the time-scale of orbital motion of gravitational-wave detector. 

Provided the product signal JSJ, detectability of the GWBs is quantified by defining the signal-to-noise ratio (SNR): 

SNR = ( ^) V2 t±L = ( T^l] V2 (6) 



V T J s /j 



In the above expression, the mean value /i 7J = (SVj) characterizes the GWB signal, and the noise contribution to 
it becomes vanishing when the noises n I and n 3 are statistically independent of one another. On the other hand, 
the variance £ 2 ; = (Sfj) — (Su) 2 is related to the root-mean-square amplitudes of noises which give dominant 
contributions in the weak-signal limit. Thus, Eq. 10 naturally represents the SNR. Note that the factor (Tobs/i") 1 / 2 
arises from the assumption that the output signal Su in each chunk data can be treated as a statistically independent 
variable. Furthermore, the amplitude of SNR depends on the optimal filter function. In order to increase the sensitivity 
to the gravitational- wave signals, an appropriate functional form of the filter function Q(t) or its Fourier counter-part 
Q(f) must be specified, which we will focus on later. 

The definition (jfJJ provides a useful measure to discuss the detectability of isotropic GWBs. On the other hand, 
when the sky distribution of GWB is anisotropic, it is more convenient to introduce an alternative measure to explore 
the detection of anisotropic components in GWBs. To do this, first notice that the signal Su cannot be rigorously 
treated as stationary random variables. As the detector sweeps across the sky, the observed amplitude of GWBs 
varies in time, since the detector's sensitivity to GWs has a strong directional dependence (See [2(| for an example 
of time variation of output signal). For instance, when the detector orbits around the Sun with the period T or bit, the 
ensemble average (Su) also has periodicity in time, and one can expand it with frequency u> = 27r/T or bit as 

(Su(t))= Yl (^,m)e im ^. (7) 

m— — oo 

Thus, the information about anisotropies is encoded in the coefficient (S IJim ) (m 7^ 0), and it can be detected if 
m 7^ component is sufficiently large compared to the noise contributions. Accordingly, in similar manner to the 
isotropic case, one can define the SNR by 

(SNR) m = ( ^ t^SL^f £±) V2 l Bddl (8) 



^orbit / ^u.m 



rbit 



Here, the factor (Xobs/TLrbit) 1 / 2 differs from the one in the isotropic case ©, since the signal Su,m should be 
evaluated in each orbital period and statistically independence is only achieved between the variables measured at 
different period. 

III. OPTIMAL FILTER FUNCTION AND SIGNAL-TO-NOISE RATIO 

A. Isotropic signals 

In this section, we discuss how to choose an optimal filter function to increase the SNRs of GWB in both isotropic 
and anisotropic cases. Consider first the isotropic GWBs in which the power spectral density Sh is characterized only 
by the frequency /. In this case, the task is to calculate the quantities /i /i7 and S J7 and determine Q(f) so as to 
maximize the SNR. In appendix [S] owing to the Gaussian assumption, the statistical quantities are calculated and 
the results are presented there. Here, we only quote the final expressions. 

Under the assumption that the two different detectors (or output data stream) have no correlation of noise, the 
mean value of the output /x 7 J becomes 

f°° df ~ r i 
Hu=t fQ(f) Cu{f;t,t) + SuNj(f) , (9) 

where the quantity C'u(f;t,t) is defined as 

Cu(f;t,t) = J ^s h (f)Fu(f,n-,t,t). (io) 
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The quantity J-,., denotes the antenna pattern function (see Eg. l|A4|) l. In the case of isotropic GWBs, the so-called 
overlap-reduction function 7(/) can be defined and is related with T,j (e.g., 0,H3|): 



(ii) 



The explicit functional form of the antenna pattern function is determined by the detector tensor D] J as well as the 
motion of gravitational- wave detectors (see Appendix [5J . Note that while the time-dependence appears in the above 
expression, the final output C Id itself is statistically independent of time in the case of isotropic GWBs. Hence, we 
omit the time dependence and simply denote C IJ {f) hereafter. 

The general expression for £ 7J is rather complicated and requires a lengthy calculation. Hence, we first focus on the 
weak-signal limit as the simplest case, in which the amplitude of instrumental noises is assumed to be large compared 
to that of the gravitational- wave signals, i.e., h^t) <C nj(t). In this case, the squared quantity £ 2 7 is reduced to 



(Si) 



'1 
2 



Q(/) NtWNjtf). 



(12) 



Based on the expressions © and (B) , let us determine the functional form of Q(f) that maximizes SNR. According 
to |22| . this becomes remarkably simple if we introduce an inner product (A|B) for any pair of complex functions 
A(f) and B(f): 



(A\B) 



df 



A*(f)B(f) NtifiNjif). 



In terms of this, the SNR JBJ) is rewritten in the form: 



SNR 



(Q\Q) 



Q" 



C,,U) 



(13) 



(14) 



Here, we only consider the case I ^ J. For the self-correlation signal (/ = J), the mean value \i I3 contains the 
instrumental noise spectrum and the signal cannot be optimized (see below). 1 Since (^4|-B) satisfies the same 
properties as held for an ordinary inner product of vectors in three-dimensional Euclidean space, the norm is positive- 
definite. Then the problem to determine the filer function is analogous to find the vector Q that maximize the quantity 
(Q • A) 2 /(Q ■ Q). The answer is 



<?(/) = 



Ni(f)Nj(f)'' 



(15) 



where c is merely an arbitrary constant. The resultant filter function Q(f) depends on the spectrum of GWB as well 
as the antenna pattern function and the instrumental noises. Thus, within the bandwidth for interest of gravitational- 
wave detector, some templates of th e sp ectrum Sh(f) is needed to detect the GWBs. Substituting l|15fl into (|14|) . the 
SNR is finally obtained in the form 



SNR ~ ^2 T ohs 



df_ \CUfW 
2 N^Njif) 



1/2 



(I ^ J, hi <c nj). 



(16) 



The above results are now well known in the literature and have been currently used in the data analysis of GWB 
searches, because most of the candidate for GWBs is far below the noise sensitivity of ground-based detectors. In 
general situations with large amplitudes of GWBs, which may be the case for the next-generation space interferometers, 
there appear the additional terms that contribute to the variance S^. Their final expression is 2 



2 



Q 2 (f) V(f)+ Q(f) W(f) 



(17) 



1 Furthermore, it is worthwhile to note that for the cross-c orre lation between so-called A, E, T variables the signal-to-noise ratio vanishes 
because of Cjj = (I ^ J, I = A, E, T). As proved in Il9l . this property is the general consequences of the spacecraft configuration, 
and then it holds true irrespective of the choice of filter function. This is a kind of null signal stream for a stochastic background sources. 

2 By construction, the variance S|j should be a positive definite function. This consistency is explicitly satisfied for self-correlation 
because Nj(f) and Cu arc positive definite real functions. However, for cross-correlation, positive definiteness of the variance seems 
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where the functions V(f) and W(f) are defined by: 

U(f) = CM + SrjN^f), 

V(f) = U 2 = [C tJ ] a + S tJ N, 



Nj + 2C„ 



W(f) = C II C JJ + C II N J + C JJ N I + N 1 N J . 

In the above expressions, W is a real function, while U and V are generally complex functions of /. Note that this 
situation is somewhat different from those considered by Allen & Romano [2^. In their paper, the quantity Cj, 7 is 
assumed to be real, since they particularly focused on the ground-based detectors of Fabry-Perot type. Then the 
overlap-reduction function 7(/) is a real function of / and accordingly the functions U and V becomes real. The 
integrand in right-hand-side of Eq. (|17f) may be factorized as |Q| 2 {V + W} and the explicit functional form of the 
optimal filter is derived just following the same procedure as discussed in the weak-signal limit. 

For space-based detectors whose signal extraction method relies upon the Dopplcr tracking technique, O rj (f) is not 
necessarily a real function because the overlap-reduction function "/(f) sometimes becomes complex. This generally 
happens unless the relation J 7 u(f, fi) = F*j{f, —SI) holds for the antenna pattern function, depending on both the 
detector tensor Df and the specific combination of time-delayed signals 3 . In that case, the quantity SNR cannot 
be simply expressed by using the inner product Here, to generalize the above-mentioned procedure, instead of 

using we introduce a new inner product: 



{A\B} 



M(/)-B(/), 



(18) 



where A and B represent two-dimensional vectors, whose component is defined by A = (A, A*). The complex matrix 
M is given by 



M(/) 



fW(f) V*(f) 
\ V(f) W(f) 



(19) 



Recalling the fact that V*(f) = V{-f) and Q*(f) = Q(-f), Eq. (TQ is rewritten as T? TJ = (r/2) {Q\Q}. Similarly, 
the mean value \iu becomes 



df 



U(f)Q(f) + U*(f)Q*(f) 



uv* — u*w 



\v\ 2 -w 



Q 



The squared quantity SNR is thus expressed in a closed form using the new inner product: 

2 



SNR 2 = 2Tohs \ UV *~ U * W 

{Q \Q] I l^l 2 -^ 2 



(20) 



Since {^4|-B} satisfies the same properties as held for (A\B), it is now straightforward to determine the optimal filter: 



Q(f) 



U(f)V*(.f)-U*(.f)W(f) 
\ V (f)\*-W*(f) 



(21) 



non-trivial due to the first term in the integrand 1171 . i.e., (C/j) 2 , which is in general a complex variable. This term comes out after 
the application of the Wick theorem (Appendix^}. (Note that this is not a problem for ground- based detectors because the antenna 
pattern functions of ground-based detectors are real functions.) The positive definiteness can be shown as follows. If the inequality 



\Q\ 2 C n Cj 



> 



is proved to be satisfied, then the positive definiteness is explicit, 
tion Cij as an inner product for complex vectors defined by F/ = 



To prove this inequality, we consider the complex func- 
e -<air/n-xj^+ ) jr / X). Then, one finds an inequality 1 > 



2 df \Q\ 2 [CuCjj — |C/,/| 2 ] , where we have used the fact that — 2|z| 2 < z 2 +z 2 < 2|z| 2 and \z\z2\ = |zi||z2| for complex variables. 
By applying the Schwarz's inequality |C/j| 2 < CuCjj, the above inequality is shown to be satisfied, and the proof is completed. 
For cross-correlation analysis (I J), the relation f2) = J-*j(f, —CI) holds only among the same types of (first-generation) TDI 

variables. If we consider a cross-correlation between different type of TDI variables, for example between Sagnac variables and so-called 
X variables, the relation is not true. (This type of cross-correlation is possible for a hexagonal space-interferometer withou t introducing 
correlated noises.) Furthermore, for much complicated time-dependent TDI variables like the second-generation 12:1 L'4l . the relation 
does not hold anymore in general. 



6 



The filter function (|21|l is ageneralization of the result in weak-signal case. This is also an extension of the result 
given by Allen & Romano |23 (c.f. Eq. (5.13) of their paper) to the situations in which C IJ (f) is complex. With the 
new optimal filter, Eq. 112011 leads to 



SNR= y/2T, 



ol.JS 



'1 
2 



\u(fW + w(f) 



1/2 



(22) 



It is worthwhile to note that the SNR SNR as well as the optimal filter Q(f) gives a meaningful definition only in 
the cross-correlation case (I ^ J). For the self-correlation (I = J), the function U(f) becomes real and the relation 
V = W — U 2 holds, which makes the expression (|21|1 ill-defined. This means that the SNR for self-correlation signal 
cannot be maximized by the filter function and it should be simply given by the ratio C II (f)/N I (f). Accordingly, the 
dependence of the observational time is dropped and SNR does not increase in time. This is a natural consequence 
and is even true in the weak-signal limit [see Eq. (|16|) ]. 

Finally, we note that the results l|21|l and (12211 can be rewritten in terms of the overlap reduction function (1111) as 



Q(f) 



SNR 



2 s h (fh*Af) 

5 R(f) : 



obs 



'1 

2 



R(f) 



-,1/2 



(23) 
(24) 



with the function R(f) being 



R(f) = (§) S 2 h (f) (| 7jj | 2 + 7 „ 7jj ) + ^ h (/)( 7li Nj + 7jj (/) N t ) + N, Nj 



(25) 



Compared with the results in Ref. [22] (see Sec. 5- A of their paper), the above expressions are more general and are 
also applicable to the cases with Im[ 7jJ ] ^ or 7 „ ^ 0. 



B. Anisotropic signals 



We next discuss the anisotropics of GWB, which may be a key ingredient to discriminate between the cosmological 
origin and the Galactic origin of GWBs. In the presence of anisotropics, the m ^ components of the coefficients 
A*u,m and given in JHJ) become non- vanishing. The important point to emphasize is that the actual values 

of m / components is not only determined by the GWB signal Sh(f,Q), but also by the angular response of 
gravitational-wave detectors as well as the instrumental noises. 

While the expression of fiu, m is easy to derive, a full expression of Sjj.,„ requires a rather lengthy calculation, 
together with some approximations. Details of the calculation are described in Appendix fAI The final results are 



df 



Q(f) C 1J ^ n (f) + S ma 6 1 . J N I (f) 



— oc 

I 



T, 



orbit 



df 

2 



Q 2 (f)V m (f)+ Q(f) W m (f) 



where the functions V m (f) and W m (f) are given by 

V,n(f) = ^C^Crj^n + Su 2C IX , N X 
n 

W m (f) = ]T C JJ ,„C JJ ,_„ + C IIfi Nj + Cj^qNj + ( ) N T Nj, 

n 

with the correlation signal C IJ . m (f) being 



— m 

T 



Cjj,m\f) 



T, 



orbit JQ 



dt e 



(26) 
(27) 



(28) 
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Here, the timescale T* has been introduced to characterize the signal correlations observed at the different times. 
Roughly speaking, it is inversely proportional to the velocity of detector (spacecraft) times the observed frequency, 
i.e., T* = (2ttx i The above expression is valid when the local observation time r is sufficiently longer than T*. 

The full expression (|27|) implies that the m = component of the GWB signal as well as the other contribution of 
anisotropic signals may act as a disturbance, which reduces the SNR of anisotropic GWB. This might be crucial for 
the detection of anisotropies in the strong-signal case, which is indeed the case considered in |20j |. On the other hand, 
for the next-generation space interferometers, the observational frequency band is around / ~ 0.1 — 10 Hz and the 
dominant sources of GWB are extragalactic and cosmological origin. Thus, the anisotropic components are expected 
to be very weak. While several GW sources could produce large amplitude of (isotropic) GWB, the anisotropies of 
them are still small. For this reason, we hereafter focus on the weak-signal cases, and write down the expressions for 
the SNR as well as the optimal filter in the cases. 

Taking the weak-signal limit, Eq. (|27|) now reduces to 



2T n 



bit 



'1 

2 



Q(f) N,(f)Nj(f). 



(29) 



This expression is very similar to Eq. 112(1 in the isotropic case. Thus, one may use the same definition of inner 
product as defined in Eq. H13[) to express the SNR ©. We then have 



(SNR) r 



(Q\Q) 



Q* 



C/j,m(/) 



(I? J). 



(30) 



The optimal filter for m-th component is Q m cx C IJtm /NjNj, and the resultant expression for SNR is 



(SNR) ~ yfiTa* 



df_ \C I ±JJ)l 
2 N t {f)N 3 {f) 



1/2 



(I ^ J, hi <C nj). 



(31) 



This expression is the same equation as first derived by Allen & Ottewill [25j and has been frequently used in the 
literature. In the next section, we will use Eq. I|31|) to discuss the detectability of dipole anisotropy induced by the 
proper motion of our local system. 



IV. SENSITIVITY OF NEXT-GENERATION SPACE INTERFEROMETERS TO STOCHASTIC GWBS 



A. Interferometer design 



Currently, practical interferometer design as well as precise orbital configurations for proposed future missions 
are still under debate and are not fixed. Nevertheless, it is commonly accepted that the next-generation space 
interferometers will aim at detecting the GWB of primordial origin generated during the inflationary epoch. In this 
respect, the low- frequency band that is not compromised by the astrophysical foregrounds is thought to be favorable 
and the frequency around 0.1 — 1 Hz would be the best observational window. Based on these, we consider several 
types of intcrfcromctric design and discuss prospects for the detectability of primordial backgrounds owing to the 
correlation analysis. 

Fig. H shows an example of the constellation of the spacecrafts as well as the orbital configuration of space interfer- 
ometers. We assume that the future missions consists of four sets of detectors; two of which consist of three spacecrafts 
forming a triangular configuration, like LISA, and the remaining of which consists of six spacecrafts forming a star-like 
constellation. Each of the three detectors are located separately 120° ahead or behind on the orbit around the Sun. 
With this setup, we now consider the three possible cases summarized in Table [I] For comparison, we also list the 
instrumental parameters of LISA. 

The original DECIGO (or BBO) is planning to use Doppler-tracking method as will be implemented in LISA. In 
such signal processing technique, the output signals sensitive to gravitational waves are constructed by time-delayed 
combination of laser pulses to cancel out laser frequency noises. This type of intcrfcromctry is known as time-delay 
interferometry (TDI). To distinguish the original DECIGO from FP-DECIGO, we call the original one TDI-DECIGO. 
To examine the detector sensitivity to both the isotropic and anisotropic GWBs, we use the Michelson-like TDI 
variable called X (Y, Z) variables [2i| (see Appendix [BJ. With this specific data stream, we perform the cross- 
correlation analysis using the signals extracted from the spacecrafts forming a star-like configuration. On the other 
hand, the signal processing of the space interferometer FP-DECIGO may adopt the same technique as used in the 
ground detectors. The essential requirement is that the relative displacement between the spacecrafts to be constant 
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FIG. 1: A typical orbital configuration for a future space interferometer. One of the three interferometers on the ecliptic orbit 
consists of six spacecrafts, and the six probes form a hexagonal space-interferometer. 





L[m] 


S shot [mHz- 1 '' 2 ] 


SaccciIms^Hz- 1 / 2 ] 


interferometric type 


LISA 


5 x 10 a 


2 x ltr 11 


3 x 1(T 10 


Doppler tracking 


TDI-DECIGO/BBO 


5 x 10 7 


1.2 x i(r 16 


3.9 x KT 17 


Doppler-tracking 


FP-DECIGO 


1 x 10 e 


2.2 x KT 18 


7.9 x KT 19 


Fabry-Perot with fineness T = 10 


Ultimate DECIGO 


5 x 10 7 


3 x i(r 19 


3 x KT 19 


Doppler-tracking limited by quantum noise 



TABLE I: Instrumental parameters for next-generation space interferometers (see also Appendix[BJ. Radiation pressure noise 
of FP-DECIGO is set to S ra d = 6 x 10" 26 /" 2 [1 + {f / fo) 2 ]~ 1/2 H2 _1/2 where f is given by f = c/ATL, and the fineness 
is T — 10. The shot-noise should also accompany the cutoff frequency, like S'shot oc 

[1 + (///o)T 1/2 - Ultimate DECIGO 

is an ultimate GW observatory whose sensitivity is only limited by the standard quantum limit, and its effective noise level 
used in this paper is listed in the table. For a 100 Kg mass and an arm length of that of TDI-DECIGO/BBO, the spectral 
amplitude of the noise could be ~ 10~ 26 Hz -1 ^ 2 around 0.1 Hz. The sensitivity curves are shown in Fig. |2] Note that the 
instrumental parameters in the table do not necessarily represent latest mission plans. The mission design of BBO adopts 
different instrumental parameters. 



during an observation. Adopting the Fabry-Perot configuration, while the arm-length of the detector can be greatly 
reduced without changing the observed frequency range, no flexible combination of time-delayed signal is possible 
anymore. We assume that the output data which is available for data analysis is only one for each set of detectors. 
The third class of space interferometer discussed in this paper is the ultimate DECIGO. It is an extreme version 
of TDI-DECIGO, whose signal sensitivity is limited only by quantum noises. Although the significant technological 
developments are necessary to achieve the ultimate sensitivity, we intend to consider it as an observational limitation. 

In Fig. [21 the solid lines show the sensitivity curves for four types of interferometers. Compared to TDI- 
DECIGO/BBO and ultimate DECIGO, the best sensitivity of FP-DECIGO is slightly shifted to the higher frequency 
band, / ~ 0.5 — 10Hz. As a result, while the strain amplitude of FP-DECIGO has even better sensitivity than that of 
TDI-DECIGO/BBO, it conversely becomes worse when quantifying the sensitivity by means of fi gw . Note, however, 
that the sensitivity curves plotted here just represent the noise intensity in comparison with the detector response 
and do not correctly reflect the detection limit of GWB. The quantitative aspect of the detectability of GWB should 
be investigated through the cross-correlation analysis, which we will discuss in detail. 



B. Isotropic case 

To see how the cross-correlation analysis improves the sensitivity to the GWB, let us first focus on the isotropic GWB 
and evaluate the sensitivity of each space interferometer. For this purpose, we take the weak-signal approximation. 
From Eq. I|16fl (or Eq. (|24[) L we introduce effective strain sensitivity fl9L |29| : 

1/2 [5 N^NAf) 1 1/4 



hes(f) = SNR {- - Y'"; J ' , (32) 

2 huun A / T obs 



where the quantity SNR means the signal-to-noise of stochastic GWB over the frequency range / ~ / + A/. Eq. (1M2I) 
quantifies the strain amplitude of minimum detectable GWB for different frequency bin. Unlike the usual sense of 
the sensitivity curves, it depends on the observation time as well as the frequency interval. 

In Fig. El the effective sensitivity of cross-correlated signals for TDI-DECIGO/BBO and FP-DECIGO are shown 
(dashed and dot- dashed). Compared to the curves for self-correlation signals, the sensitivity of the cross-correlated 
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TDI-DECIGO/BBO 
FP-DECIGO 



FP-DECIGO 

i 




10 10 
f[Hz] 



10 



FIG. 2: Spectral amplitude sensitivity h e g for several space-based interferometers |27I[ . Solid curves show the sensitivity 
for self-correlation analysis for LISA, TDI-DECIGO/BBO, FP-DECIGO and ultimate DECIGO (Table |TJ. So-called in- 
variable |2(| of TDIs is used for the self-correlation analysis, and the transfer function of FP-DECIGO can be found in, 
e.g., [2H . The dashed curves show the sensitivity for cross-correlation analysis, assuming the hexagonal spacecraft configura- 
tion. Oscillation of the sensitivity curves at high frequency band comes from overlap reduction function. Dotted lines show 
/i 2 fi gw = 1(T 10 , 1(T 12 , • ■ • , 1(T 18 . In these plots, we have taken SNR = 5, A/ = //TO, and T obs = 1 year. 



signals is greatly improved more than one order of magnitude in the strain amplitude. With the signal-to-noisc 
ratio SNR = 5, the minimum detectable ft gw reaches ft gw ~ 10" 16 (10" 15 ) for TDI-DECIGO/BBO (FP-DECIGO). 
Increasing the observational time, the effective sensitivity becomes even comparable to the sensitivity of ultimate 
DECIGO. 

While the effective strain sensitivity h c ff provides useful information on the frequency dependence of the detectable 
amplitude, for more precise estimate of the SNR, one must directly evaluate the expression ()16|) . integrating over the 
whole frequency bins. Assuming the flat spectrum, r2 gw (/) = f2 gWi o/°, the resultant detectable values of f2 gw are 



i7 gw q — < 



16 ^SNR^j 
4.2 x 10- 



6.8 x 10~ 18 
1.1 x 10 



/ Tobs y 1/2 

Vlyear/ 

/ Tobs \ 1//2 

\lyeax) 

/ Jobs \ 

Vlyear/ 



(TDI-DECIGO/BBO) 
(FP-DECIGO) 
(ultimate DECIGO) 



(33) 



As anticipated from the effective sensitivity curves, the minimum detectable value of f2 gw for TDI-DECIGO/BBO is 
an order of magnitude lower than that for FP-DECIGO. In this sense, the frequency band around 0.1 — 1Hz covered 
by TDI-DECIGO/BBO may be the best observational window to probe the GWB of primordial origin. 

The above discussion is, however, rather optimistic. In practice, one would not neglect several astrophysical 
foregrounds. As it has been discussed by several authors [3(|,|3l]|, a cosmological population of white-dwarf binaries 
may produce a large signal at low-frequency band / < 0.2Hz, which would not be resolved individually. Hence, the 
cosmological white-dwarf binaries may act as a confusion noise and they prevent us from detecting the primordial 
GWB below the frequency / cu t = 0.2 Hz. As recently pointed out by Seto [32], the introduction of the low-frequency 
cutoff in the integral (|16fl significantly reduces the SNRs for the GWB signals. To see how this affects the detectability 
quantitatively, we plot the minimum detectable fl gw as a function of the cutoff frequency / cut in Fig. [3] 

Clearly, the effect of low-frequency cutoff is significant for TDI-DECIGO/BBO. The minimum detectable amplitude 
for /cut <] 0.1 Hz becomes 100 times worse. By contrast, as long as the cutoff frequency is below 0.1Hz, the minimum 
detectable amplitude of FP-DECIGO almost remains unchanged. As a result, with the cutoff frequency / cu t = 0.2 
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FIG. 3: Dependence of low-frequency cutoff / cut on the minimum detectable value f2 gw in the case of flat spectra, f2 gw cx /°. 
The resultant values f2g^, toff are plotted by normalizing them to fi gw without cutoff. Observational band (available frequency 
band) is the same as shown in Fig. [5] 



Hz, the minimum amplitude f2 gw ,o^ 2 is changed to 



l/l QCUtoff 

n 12 gw,0 



5.8 x 10 



-15 



4.8 x 10" 16 



1.2 x 10 



-1!) 



-1/2 



(r^r) 



-1/2 



( 2*1. \ 

Vlyear/ ^ 

(lyear) (ultimate DECIGO) 



(34) 



Thus, in contrast to the previous estimate (|33[) . FP-DECIGO has a potential to achieve better sensitivity than TDI- 
DECIGO/BBO, and the frequency covered by FP-DECIGO would be practically important to probe the primordial 
GWB. (See also Fig. 0] and discussions below.) Nevertheless, it is premature to conclude that the slightly higher 
frequency around 0.5 — 5 Hz is the best observational window. Even above the frequency / ~ 0.2 Hz, we still have 
foregroun ds p roduced by the resolvable binaries made of neutron stars or black holes, which must be subtracted 
perfectly |33j . Further, there might exist a large confusion noise arising from cosmological supernovae and/or hy- 
pothetical early population of massive stars jU which could dominate over the GWB of inflationary origin. These 
points are extremely important to give a practical mission design and must be clarified. 

So far, we have quantified the SNR and the minimum detectable amplitude of £7 gw by taking the weak-signal limit. 
Before closing this subsection, we discuss the validity of the weak-signal approximation. The left panel of Fig.0|sliows 
the optimal filter functions Q(f) for TDI-DECIGO/BBO in cases with various amplitude of GWBs. Assuming the 
flat spectra f2 gw cx /°, all the filter functions show a symmetric single-peak on a logarithmic scale of the frequency. 
As increasing the amplitude of f2 gw , the location of the peak of the generalized optimal filter (|21fl [or Eq.J33J)] moves 
to higher frequency, while the filter function in the weak-signal approximation (|15J) remains unchanged (apart from 
the overall normalization). In the right panel of FigQ] the SNRs for GWB are quantified taking account of the 
low- frequency cutoff. The SNR taking the weak-signal approximation (thin- dotted) generally tends to overestimate 
the signal-to-noise estimated from general expression (|24() (thick) and the discrepancy becomes significant above 
SNR ~ 100. This is because the general expression of SNR includes the GWB signal in both of the numerator and 
the denominator, while no such signal appears in the denominator when taking the weak-signal limit. Nevertheless, 
for sufficiently small amplitude of f2 gw , the SNR of weak-signal approximation converges to the values obtained from 
the generalized optimal filter, as anticipated from the left panel. Although the convergence property depends on 
the cutoff frequency / cu t as well as the interferometer design, one can apply the weak-signal approximation to the 
correlation analysis of space interferometers as long as f2 gw < 10 -15 . 
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FIG. 4: Left: optimal filter functions for isotropic GWB with various amplitudes f2 gw in the case of TDI-DECIGO. In plotting 
the functions, all the filters are normalized to have maximum magnitude equal to unity. Right: signal-to-noise ratio (SNR) 
as function of /i 2 fi gw with and without the low- frequency cutoff. Dashed curves shows the SNR with the cutoff frequency 
/cut = 0.2 Hz. Respective dotted thin lines depict the SNR based on the weak-signal approximation 11611 . 



C. Anisotropic case 

GWBs may exhibit anisotropic components in the sky distribution. This seems quite natural because the GWB 
of astrophysical origin can trace the spatial distribution of luminous galaxies, which gives a strong clustering pattern 
on small angular scales. Further, the primordial GWB generated during the inflation may also give an anisotropic 
component, like the CMB. In particular, a dipole moment arising from the proper motion of the solar-system barycenter 
would be observable with a future mission of space interferometer. Indeed, COBE [3f| and WMAP [3(| satellites 
have detected and determined the dipole moment of CMB, which is attributed to the motion of the solar system 
with respect to the CMB rest frame. The CMB dipole has amplitude 3.35 mK towards the Galactic coordinates 
(l',b f ) = (264°, 48°) or the ecliptic coordinates (0e,#e) = (172°,— 11°). This implies that our local system is moving 
with a velocity (3 = v/c = 1.23 x 10~ 3 in that direction, and then the observed frequency Jobs suffers from the Doppler 
shift. If the CMB rest frame and the isotropic GWB rest frame are identical, the anisotropy induced by our proper 
motion towards l~i E = (</>e;^e) becomes 

S h (f ohs ) = Sj?\f) [l + ^/3{cos0 E cos0 E cos(0E-0E)+sin0 E sine E }] . (35) 

Here (/) denotes the isotropic component of intensity distribution and N = d rf 1 " n '^'' is the tilt of the spectrum. 
The induced multipole moments pf m (f), which is defined by Sh = Y^imPim¥em in the ecliptic coordinates, are 



(36) 



Based on this, one finds that the non- vanishing components of the correlation signal C IJ ^ rn (f) given by Eq. I|28|) are 
m = 0, ±1 and ±2: 

CufiU) = Y7^{ 4fl ooPoo + ai + 2ai p?o + aupf*}, 

C^M) = ( 37 ) 

and C /J . m (/) = C* j /) for I =/= J. Here, the coefficients ag m (f) represent the multipole moments of the antenna 
pattern function J 7 u(f, fi) defined at the detector's rest frame. The relation between the multipole moments defined 
at the ecliptic frame and detector's rest frame is given by the Euler rotation matrix and an explicit expression can be 
written in terms of the Wigner D matrices 0, |2(J, 153, EH . 
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Since the m = component of the correlation signal is dominated by the isotopic component of GWB, only the 
m = 1 and 2 components are relevant for detecting the anisotropies of GWB. For TDI-DECIGO/BBO as well as 
ultimate DECIGO, we further note that the multipolc coefficient aio vanishes for the cross-correlated X variables of 
the star-like configuration. Hence the m = 1 component of correlation signal contains only the information about pf Q . 
Assuming a flat spectrum of fl gw in the observational band, our estimates of l|31[) for the future space interferometers 
are 



(SNR)i = 5 



Jobs 

1 year 



1/2 



h 2 n„ 



X < 



and 



(SNR) 2 



1/2 



1 year , 



x < 



1 o v in- 

l.Z X 1U 
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h 2 <D 




2.0 x 10" 


- 10 






1.6 x 10- 


-16 






5.3 x 10" 


12 






8.3 x 10" 


10 






6.7 x 10- 


16 



(TDI-DECIGO/BBO) 
(FP-DECIGO) 
(Ultimate DECIGO) 

(TDI-DECIGO/BBO) 
(FP-DECIGO) 
(Ultimate DECIGO) 



(38) 



(39) 



It is thus challenging problem to test observationally whether the CMB rest frame and the GWB rest frame are 
identical. If the amplitude of isotopic GWB is larger than the values listed above, we could observe the induced dipolc 
moment of GWB and tackle the problem. We note that at the frequency below 0.2 Hz, cosmological population 
of binaries constitutes the GWB with amplitude Q gw ~ 10 -11 |33,|^|. Therefore, the induced dipole moment of 
the astrophysical foreground would be detectable. This is analogous to the observation of a velocity dipole in the 
distribution of radio galaxies |3^] . 

Notice that the dctectability of anisotropic components depends on not only the intensity distribution of GWB but 
also the angular sensitivity of antenna pattern function for space interferometer. To better understand the extent to 
which the next-generation space interferometers can probe the anisotropies of GWB, it may be helpful to quantify the 
strain sensitivity for each detectable multipolc moment. Likewise Eq. (|32|) . we introduce the effective strain sensitivity 

^eff(/) f° r rnultipole moment £ 4 [l9j : 



^(/) = SNR^ Utt 



1/2 



aj(f)AfT ohs 



1/4 



(40) 



Here, the quantity cri(f) means the rotationally invariant representation of the angular power of antenna pattern 
function J r u(f; ft) for multipolc moment £ [lfltlioj: 



4{f) 



2( 



1 1 

— K™(/)r 



(41) 



with ai m being the rnultipole moment of antenna pattern function at detector's rest frame. Note that we have 
dp = Ait |(2/5) 7j. 7 | 2 . Thus, for the monopole moment (£ = 0), the definition (|40|l correctly recovers the effective strain 
sensitivity for the isotropic GWB in l|32|) . 

Fig. shows the effective angular sensitivity of SNR = 5 for the next-generation space interferometers TDI- 
DECIGO/BBO (left) and FP-DECIGO (right). Similar to Fig.0 we set the observation time T obs to 1 year and the 



4 We can give a theoretical basis for this effective strain sensitivity. A natural definition of effective strain sensitivity for each rnultipole 
moment is fi^ = S^rn , where the effective power spectrum for each harmonics is defined by [Sh(£)] 2 = 5Z m IP^rJ 2 /['^ 7r ('^ U]- 
Then the problem is how we define SNR for each rnultipole. Since the antenna pattern function (in the detector's rest frame) and GW 
luminosity distribution can be expanded by the spherical harmonics, Cijkif) is also given in terms of the rnultipole coefficients, like 
Eq. 1371 . Substituting such expansion into Eq. 1311 . we can naturally introduce an appropriate SNR for each rnultipole moment. Then 
after some approximation, we arrive at the result 1401 . 
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f [Hz] f [Hz] 

FIG. 5: Effective strain amplitude h cS for TDI-DECIGO/BBO (left) and FP-DECIGO (right). In plotting the sensitivity 
curves for TDI-DECIGO/BBO, we specifically consider the cross-correlation between the TDI X- variables extracted from the 
nearest spacecrafts in the star-like configuration. In both cases, the interferometers are most sensitive to lower even multipoles 
of I = 0, 2, 4. Because of the hexagonal form, the detectors are also sensitive to lower odd multipoles i = 1, 3, 5. The sensitivity 
to higher multipoles I > 6 is very poor and this fact is especially evident in the low frequency band. 



band width A/ to //10. Interestingly, the resultant strain sensitivity for each multipole moment shows a band-like 
structure. The future space interferometers are more sensitive to the even multipoles I = 0, 2 and 4 than the odd 
multipoles t = 1, 3 and 5. These behaviors can be ascribed to both the low- frequency properties of antenna pattern 
function and the geometric configuration of space interferometers |l9j . As a consequence, the angular resolution of 
space interferometers is rather poor and the detectable multipole moments are very restrictive. At / ~ 10Hz, the 
sensitivity of FP-DECIGO may reach I ~ 5 with the effective sensitivity h^2 ~ 5 x 10 -24 Hz -1 / 2 , corresponding 
to h 2 il gw ~ 10~ 9 . At the same frequency band, the angular sensitivity of TDI-DECIGO/BBO is much worse, as 
well as the response to the GWB becomes quite complicated because of the oscillatory nature in the antenna pattern 
function. 



V. SUMMARY 



We are currently in the early stage to make a conceptual design of next-generation space interferometers. The 
planned future missions will be dedicated to detect the stochastic GWB of cosmological origin. In this paper, we have 
discussed the detection of such GWB via correlation analysis and studied prospects for direct measurement of both 
isotropic and anisotropic components of GWBs by future missions. For this purpose, we have presented the general 
expressions for signal-to-noise ratio. Taking the weak-signal limit, the optimal filter functions were defined so as to 
increase the sensitivity to the GWB signal. In the isotropic case, a generalized optimal filter was derived, which can 
be used in any combination of output signals with arbitrary large amplitude of GWB signals. 

Based on this formalism, we have also demonstrated the feasibility of proposed future missions to detect the GWB 
produced during the inflation. Due to the geometric properties of spacecraft configuration, LISA would not probe 
isotopic GWBs by the cross-correlation analysis and the accessible minimum value of Q gw is severely restricted by 
the detector's intrinsic noise |l9j |. For the flat spectrum of fl gvJ , the minimum detectable value could reach at most 
about h 2 VL gvJ > 10~ n . On the other hand, the space interferometers, like TDI-DECIGO/BBO, which form a star- 
like configuration of spacecrafts will improve this limit greatly by seven orders of magnitude, i.e., h 2 ii < in~ 18 
which is almost comparable to the sensitivities expected for future experiments of CMB polarization 
However, there might possibly exist several astrophysical foregrounds in the observed frequency band 
which act as a disturbance of detecting the primordial GWB. We have examined the effect of foreground sources by 
introducing the cutoff frequency and found that TDI-DECIGO/BBO is quite sensitive to the low- frequency cutoff, 
while the sensitivity of FP-DECIGO to the primordial GWB almost remains unchanged, resulting in the detection 
level h 2 tt gw ~ 10~ 16 . Although there still remain some problems concerning the point-source subtraction, the result 
indicates that FP-DECIGO is a potentially suited design for detecting the primordial GWB. 

In addition to the detectability of isotropic GWBs, we have investigated the directional sensitivity of next-generation 
space interferometer to the anisotropic GWB. As a demonstration, the dipole anisotropy induced by proper motion 
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of local observer was considered. For cross-correlation signals extracted from the star-like spacecraft configuration, 
the interferometers are more sensitive to the even modes (I = 0, 2, 4) than the odd modes (£ = 1, 3, 5) as anticipated 
from Ref. 0] . Accordingly, the detection of dipole anisotropy would be possible only when the isotropic component 
is /i 2 f2 gw > 10 -11 . Hence, although very interesting, it would be hard to probe whether the CMB rest frame and a 
GWB rest frame are both identical or not. 

In any case, space interferometers will be a cornerstone for a new understanding of the Universe. We hope that 
the present study will be helpful for developing and fixing the pre-conceptual design of next-generation of space 
interferometers. 
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APPENDIX A: DERIVATION OF EXPECTATION VALUES FOR OUTPUT SIGNALS 

In this appendix, based on the statistical assumption in Sec^ we derive the expectation values for output signals 
obtained from the gravitational- wave detectors. 

The Fourier component of the output signal Sj (t) is 

*(/,*) = [ t+T/2 dt'srit')^ 2 *^'. (Al) 
J t-r/2 

Then the signal defined in Eq.(J2J) becomes 

/oo 
dfdfdf" s* 1 (f,t)s J (f',t)Q(f")6 T (f - f")6 T (f" - /') e**""-'"**, (A2) 
-oo 

where the quantity 5 T (f) represents the finite-time approximation to the Dirac delta function 5(f) p3.l25j: 

m/)- r tf^=^ (as) 

J-r/2 

which reduces to 6(f) in the limit r — > oo, but has the property 6 T (0) = r. Based on the expression l)A2|l . our task is 
to calculate the averaged quantities fj,u and /ijj, m and their variances Ejj and Sj 7 m . These are separately calculated 
in Appendix |A II and lA~2l 

1. flu and Hu,m 

In this case, it is sufficient to evaluate the quantity (Su(t)). The ensemble average (s*(f,t)sj(f',t)) is divided into 
two parts: 

<sj(/, *)«,(/',*)) = (K(f,t)h,(f,t)) + (^(/^(/O). 

Using the definitions and 10} as well as the relation QJ, we obtain 

(W, *)*,(/', *)} = \s{f-f) 

where we defined 

^(/.n^O^e* 2 *' !*'®-*'^ E [a? 6 *(n. /;*)<&(«)] [Df(n, / ; f) e^(n)] . (A4) 

A= + ,x 



^ TM «; *, *) Sh(f, n) + 6, j n, (/) 

Air 
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lit = t', this is the so-called antenna pattern function, which is related with a overlap reduction function [see Eq.JTTJ]. 
Substituting the above equation into (S , JJ (t)), we have 



M*) = (S,j(!)) = / dfdf" Q(f") [SAf - f")X 



47T 



F IJ {f,n ; t,t)s h (f,n) + 5 IJ N I (f) 



(A5) 



For our interest of the observed frequency / 3> 1/t, the function S T (f — f") is sharply peaked around / ~ f" and one 
can replace one of the finite-time delta functions by an ordinary Dirac function. Then the above equation is reduced 
to 



2 W 



An 



(A6) 



where we have used the fact that 6 T (0) = r. Note that the above result does not assume a statistical isotropy of GWB 
and can generally apply to an anisotropic case of GWB. 

Now assuming the isotropy of GWB and using the definition this simply leads to the final result 0. Also, it 
is easy to derive /ti JJjm . With uj = 27r/T or bit, we have 



1 



dt e 



'(Suit)), 



Torbit Jo 

Thus, substituting Eq. IjAfijl into the above equation, with a help of definition Ij28|) . we finally obtain Eq. H26(l . 



(A7) 



2. E? J and E? J>fi 



The derivation of E 2 j and £ 2 7 m becomes slightly complicated. We first write down the second-order correlation 
(Su(t)Su(t')): 



(Su(t)Su(t')) 



dfi df 2 dh dU df 5 df 6 Q(/ 3 ) Q(/ 6 ) e 



i2ir{(/ 1 -/ 2 )t+(/ 4 -/ 5 )t'} 



x s T (h - h)5 T (f 3 - f 2 )s T (u - h)6 r (h - h) (r I (f ll t)i J (f2,t)r I (u,t')s J (f 5 ,t')). (A8) 

The above equation includes a complicated ensemble average (s*(fi,t)'sj(f2,t)^*(f4, t')7j(f5, t')). Assuming the Gaus- 
sianity of the output data Sj(f,t) and no statistical correlations between signal and noise, this quantity is divided 
into the 12 terms by means of the Wick theorem. Collecting these terms and repeating the similar calculation in each 
term as done in Appendix IA II a lengthy but straightforward calculation yields 



(S t j(t)S,jtf)) = 



x df ~ 

oo * 

df 



2^ 



C IJ {f;t',t') + 5 1J N 1 



C IJ (f;t,t) + 6 IJ N I 

"{<?„(/; M')}* +S IJ N I {N I + C II (f;t 1 t) + C II (f;t',t')} 
Q| 2 [C u (/; t, t')C .,.,(/; t, t') + C u (/; t, t')Nj + C .,.,{}■ t, U)N t + NjNj 
Here, we have used the same notation Cu{f;t,1?) as defined in (|10fl to express the statistical quantity: 

c„(/;t,f)= / ^5fc(/ I n)^„(/ J n ; t,t')- 



Now, we define 



E^^O = (S u {t)S 13 {fl)) - (5„(t)) (5„(f)) , 



which gives 



eL(*>*') = ^ 



1 

2 



— Q 2 
2 ^ 

~ 2 



{C„(/; t, <')} 2 + + [C„(/; t, t) + C u (f; t' , t')] N, } 



Q 



C„(/; t, t')C^(/; *, + Cu (/; t, t')N, + Cjj(f; t, t)N, + NjN, 



(A9) 



(A10) 



(All) 
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Equating t with t' and assuming the isotropy of GWB, we obtain the final expression for £ 2 7 given by Eq. (|17(l . 
On the other hand, the mean value E 7J m given by ijSJ) is obtained by computing the following quantity: 



T 2 

± orbit JO 



T orbit 



dt 



T orbit 



dt' ^ 2 IJ {t,t')e i ^ mt - m ' t '\ 



(A12) 



When m = m', this coincides with the quantity Y? IJm . The evaluation of Ea. HA12|l seems rather difficult because 
the terms in Ecr. (|Allf) associated with the gravitational- wave signals involve the different-time correlation such as 
Cjj(/; t, t'), which becomes non-vanishing even if t 7^ t'. In practice, however, the effect of the different-time correlation 
becomes negligible if we consider the time-scales larger than T*. The characteristic time T* is roughly evaluated as 
T* ~ (2ir x /), where x means velocity of space craft. Thus, as long as the local observation time t is chosen as 
t T», one can approximate C IJ (f;t,t') as 



C„(/;t,t / )«T* 8(t-U)C t j(f;t,t). 



(A13) 



In Appendix |0 wc discuss the validity of this treatment in some details. 

The approximation l|A13() greatly simplifies the evaluation of l|A12|) . In addition to this, a careful treatment is 
necessary when we evaluate the terms consisting of the noise spectra only [see Eq. l|All|) ]. Since these terms have 
no explicit time-dependence, a naive calculation based on the expression (|A11(I incorrectly drops their contribution 
to the variance S /J mm /. In Appendix IO some tricks to evaluate these terms are also presented (see also Sec. IX of 
Ref . [25j ) . Taking into account of these treatments, the quantity E 2 7 mm , is finally reduced to 



2 VTorbit 



df 



Q 2 (f)V mm ,(f)+ Q(f) w mm ,(f) 



(A14) 



with the functions V mm > (/) and W mm > (/) being 

(/) + SuNt 



(/) + 



W„ 



'(/) = £ C II<n _ m (f)C JJ , m ,_ n (f) + Cu^'-miftN, + C JJ)m ,_ m (/)iV, + S„ 

n 

which leads to the final result (|27|1 when taking m = ml . 



7^ N z Nj, 



APPENDIX B: ANTENNA PATTERN FUNCTIONS AND INSTRUMENTAL NOISES 



For the detection of GWB via correlation analysis, a crucial task is a choice of output signals because it affects the 
sensitivity to the stochastic GWBs through the antenna pattern function. In the main text, the correlation analysis 
was performed using the Michelson-type TDI signals called X (Y, Z) variables in the cases of TDI-DECIGO/BBO 
and ultimate DECIGO. For FP-DECIGO, the Fabry-Perot type interferometric variables were used. Here, we give a 
specific functional form of the antenna pattern functions used in the main text. 

Let us recall the definition of antenna pattern function: 



^. ; (/,rj;t,t') = e 



i2^fCl[xi(t)-xj(t')] 



£ [Df*(nj;t)c^ b (n)} [Df(nj;t')et d (n)] 



A=+, 



Since we are especially concerned with the cross-correlation analysis between the signals extracted from the spacecrafts 
forming the star-like configuration (see Fig.^l, the position vectors x t and x,, should be set to the nearest-neighbor 
vertices in each triangular configuration. Based on these vertices as starting points, let us denote the unit vectors 
pointing to the other spacecrafts forming the triangular configuration by a and c (and a' and c') 5 . Then, the detector 
tensor for the TDI X-variable in the equal arm length limit becomes 



1-e 



-i2f 



a\t) ® a. j (t) T (a(t) ■ O, /) - c\t) ® c*(f) T (-c(t) • tl, f 



(Bl) 



5 These unit vectors inevitably depend on time, due to the orbital motion of spacecrafts. 
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where T(u ■ H, /) is the transfer function given by 



T(u • n, /) = e** (sine [ filzJL") ) e -«/a>/a+«-n> + sinc f /(1+u-O) 



e -(»/2)/(-i+u-n) 



Here / is the frequency normalized by the characteristic frequency /* = (c/2irL). i.e. / = ///*. On the other hand, 
the detector tensor for Fabry-Perot signal becomes 

D%{nj;t) = ^[a i (t)®a. j (t)-c i (t)®c i (t)] (B2) 

Likewise, the detector tensor for another triangular configuration is obtained from IBlfl or l|B2|) just replacing the 
unit vectors a and c with a' and c'. 

It is important to notice that the spectral density of instrumental noises also depends on the choice of the intcrfer- 
ometric signals. In the case of the TDI X-variables, one has 

N x (f) = 16 sin 2 / {N shot (f) + 2(l + cos 2 /) 7V acccl (/)} , (B3) 

where A^hot = (S s hot/L) 2 and N accc \ = (Saccei/ 'L) 2 (2tt f)~ A represent the spectral density of shot noise and the 
acceleration noise, respectively. The instrumental parameters 5 s hot and ^accei are listed in Tabled The noise spectral 
density of Fabry-Perot signal is 

AM/) = ^shot + ^acccl + A^rad, (B4) 

where N Iad = 

^ia.d * s ^ ne radiation pressure noise given in Table 



APPENDIX C: SOME DETAILS ON THE DERIVATION OF EO. (|A14jl 

In this appendix, we give some detailed discussions on the derivation of the analytic expression ljA14f> . 

First, we consider the validity of the approximation (|A13|) . Since the time dependence of Cu(f; t, t') arises only from 
the antenna pattern function l|A4fl and the significance of the different-time correlation mainly comes from the phase 
factor in the antenna pattern function, i.e., e l2 ^ f n l x i(f)- x i( i )] ) it would be better to focus on the role of the phase 
factor. Effectively, this term represents the coherence of the gravitational waves observed at the different detector 
sites and with the different times, X:(t) and Xi(t'). For a given frequency /, the phase factor becomes a rapidly 
oscillating function of f2 when the distance between the two detectors is sufficiently long, i.e., \x, — x } \ ^S> (2ir f)^ 1 . 
In this case, the phase factor almost cancels after integrating over the whole sky. The important notice is that the 
phase cancellation even occurs when I = J (self-correlation case). This is because x,(t) ^ x,{t') due to the motion of 
the detectors. Thus, for a sufficiently longer time-interval \t — 1'\ ^> T* = (2nXrf) , one expects that the correlation 
between the two different-time t and t' decays rapidly and the quantity C, ,( f ; t, t') gives no meaningful information. 

To show this explicitly, specifically using the optimal TDI A- variable |4J, we evaluate the quantity C u (f;t,t') 
in the self-correlation case. Figure shows the plot of C IJ (f;t,t + Si) as function of the relative time-difference 
St, assuming a white signal (Sh =const.). As is expected, Cu(f;t,t + St) is sharply peaked around St < T* and 
rapidly damped at St > T*. Thus, as long as the timescale larger than the characteristic time T* is concerned, the 
approximation 1A13(1 is valid. Note that in the correlation analysis for the anisotropic GWB, local observation time 
r should be typically chosen as few weeks because of the low angular sensitivity to the stochastic GWB. Therefore, 
we have r > T*, and the validity of the approximation l|A13|) is always satisfied. 

Let us next discuss somewhat tricky treatment to derive the final result (|A14() . As we mentioned in Appendix I A 21 
a naive substitution of the expression i|All|) into Ea. (|A12|) leads to an incorrect result, since the terms consisting of 
the noise spectra only have no explicit time dependence. To derive a correct result, one must go back to the ensemble 
average (|A8|) . Here, to show the essence, we only demonstrate the calculation in the following case: 



I(t, - / dh df 2 dh dh dh dh Q{h) Q{k) e'Mto-ttn-CA-AJt'} 

OO 

X S T {h - h)S T {h - f2)S T {h ~ k)5r{h ~ h) («* CflK (/*)) (h)n., (h ) ) , 
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FIG. 6: Plot of Cu(f;t,t + St) with respect to the time difference St for TDI-DECIGO/BBO (self-correlation case). The 
antenna pattern function is evaluated in the low frequency regime {f/f* = 2nLf/c <C 1), assuming flat isotropic GW spectrum 
(Sh = const.). Since the amplitude of Cu depends on /, we have appropriately normalized it for comparison. Due to 
the phase (overlap reduction) factor e l2 ' r ' fo '' X7 '*' ) ~ Xj '* " in Eq. ljA4fl . the oscillating function Cu decays very rapidly as the 
relative time difference increases. The characteristic time scale of the decay is readily estimated as St ~ c(L/xi) / (2nLf) ~ 
10- 3 T yoar x (0.1/,//). 



which gives a non-vanishing contribution to T%j(t,t') [Ea. l)A10|) ]. Substituting it into Ea. l|A12(l . with a help of 
definition 10}, one obtains 

^ dt [ °' b,t dt' I(t,t')e iu,{mt - m ' t "> 



1 orbit JO 



dfi df 2 dh df 6 Q(f 3 ) Q(f e ) 5 Torbit (h + h + ^) 6 Torbit U + f 2 + ^) 



± '- / df, dfn dfi d.fa Q< fol 0( fa)Srr . . f f , 4- fo -I I 

^orbit J 

x 5 T {h- f 3 )6 T (f 3 + f 2 )S r (fi + k)5 T {h- h) N",(/i)Wa), 



where we used the fact that <|A3|1 and to = 27r/T or bit- Since the local observation time r is much shorter than the 
orbital period T or bit, the effective support of ^T orbi t is very narrow in frequency space compared with the effective 
support of (5 T . Hence, one may regard ^T orbit as ordinary Dirac delta function. This gives 



(_ x yn-m' /(m'-m)cj 



W = ^ s T otbit ( v _ ' ) I dhdhdh Q{h)Q{h) 



4^ rbit *« M * V 2tt , 



OO 



X M/l - /3)*r (/3 - h ~ ^) *r(/l + f*)Sr (h + h + ^) ^(/l)^ (/l + ^) • 

In the above expression, the quantity ^T orbit m)uj/2ir) reduces to 6 mm i. Further, we notice that for |m| < Torbit/Tj 

the shifting of the arguments by mu is negligible for our interest of frequency range. Accordingly we obtain 



f-Tn.Tn.' — 



Trim, >, nrj-> I r> 

orbit ./ — r*~, ^ 



f orbit J —oo 

which appears in the last term of Eq. 1A14I) . 



df ~ 2 

Q(f) N z (f)Nj(f), (CI) 
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